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Abstract 



We report on a search for heavy neutrinos (z^) produced in the decay D s — > at 
the SPS proton target followed by the decay — ► z/ T e + e~ in the NOMAD detector. 
Both decays are expected to occur if 1/4 is a component of u T . From the analysis 
of the data collected during the 1996-1998 runs with 4.1 x 10 19 protons on target, 
a single candidate event consistent with background expectations was found. This 
allows to derive an upper limit on the mixing strength between the heavy neutrino 
and the tau neutrino in the ^4 mass range from 10 to 190 MeV. Windows between 
the SN1987a and Big Bang Nucleosynthesis lower limits and our result are still 
open for future experimental searches. The results obtained are used to constrain 
an interpretation of the time anomaly observed in the KARMEN1 detector. 



Key words: neutrino mixing, neutrino decay 



1 Introduction 



In the Standard Model all fundamental fermions have a right-handed compo- 
nent that transforms as an isosinglet under the SU(2)l gauge group except 
neutrinos, which are observed only in left-handed form. However, heavy neu- 
trinos which are decoupled from W and Z bosons and hence are mostly isosin- 
glet (sterile) arise in many models that attempt to unify the presently known 
interactions into a single gauge scheme, such as Grand Unified Theories or 
Superstrings inspired models [1]. They are also predicted in models trying to 
solve the problem of baryo- or leptogenesis in the Universe, in many extended 
electroweak models, such as left-right symmetric and see-saw models [1] . Their 
masses are predicted to be within the GeV — TeV range. The existence of a 
light (< eV or <C eV) sterile neutrino is expected in schemes that attempt to 
solve the presently observed indication from atmospheric, solar and LSND ex- 
periments that neutrinos are massive, see e.g. [2] and references therein. More 
generally one can also look for an isosinglet neutrino with intermediate mass 
such as in the keV — MeV range. For instance, such neutrinos with masses in 
the range 1-40 keV were recently considered as a candidate for warm dark 
matter [3]. 

If heavy neutrinos exist, many crucial questions arise. For example, for massive 
neutrinos the flavour eigenstates (z/ e , z/ M , v T , ...) need not coincide with the 
mass eigenstates (z/ 1; u 2 , z/ 3 , z/4...), but would, in general, be related through 
a unitary transformation. Such a generalised mixing: 
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V\ = Yl U U U i> 1 = e ' ^' T > i = !> 2 > 3 ' 4 ' 



(1) 



could result in neutrino oscillations when the mass differences are small, and 
in decays of heavy neutrinos when the mass differences are large. The relevant 
questions are then, do heavy neutrinos mix with the ordinary neutrinos and, 
if so, what are the elements of the neutrino mixing matrix Ui{l 

Since there are no firm predictions for m Ui , experimental searches of 1/4 have 
been performed over a wide range of masses. A heavy neutrino in the low 
mass region (below a few GeV) has been searched for mainly in experiments 
on the leptonic decay of light mesons and in neutrino experiments [4] resulting 
in stringent upper limits on \Uu\ 2 down to 1CT 7 , thus constraining the mixing 
amplitudes \U e 4\ 2 and |?7 M 4| 2 for the electron and muon neutrinos, respectively. 
Concerning the mixing strength |£/ T 4| 2 for the MeV mass region studied in this 
experiment a limit can be derived from some earlier papers [4], see also [5]. 
Note that stringent limits on \U T 4\ 2 in this mass range have been recently 
obtained from cosmological and astrophysical considerations [6]. For masses 
in the 3 GeV to ~ 200 GeV range the LEP experiments have set limits on 
\U T 4\ 2 varying from 10~ 5 to 10" 1 depending on the V4 mass [7]. 

The motivation and purpose of this work is to search for a neutral heavy lepton 
1/4 which is dominantly associated with the third generation of light neutrinos, 
u T , via the mixing term |f/ r 4| 2 . If such a particle exists it might be produced 
in the decay D s — > rz/ 4 at the SPS proton target followed by the decay 1/4 — > 
v T e + e~ in the NOMAD detector as is illustrated in Figure 1 (see also Section 
3). The experimental signature of these events is clean and they can be selected 
with small background due to the excellent NOMAD capability for precise 
measurements of the e + e~ pair direction. An additional motivation for the 
present study was the time anomaly observed by the KARMEN1 experiment 
( see Section 7). Although in this paper we will assume that z/ 4 has Dirac mass, 
the application of our results to the Majorana case is straightforward. 



2 WANF and NOMAD detector 



The CERN West Area Neutrino Facility (WANF) beam line [8] provides an 
essentially pure beam for neutrino experiments. It consists of a beryllium 
target irradiated by 450 GeV protons from the CERN SPS. The secondary 
hadrons of a given sign are focused with two magnetic elements, the horn and 
the reflector, located in front of a 290 m long evacuated decay tunnel. Protons 
that have not interacted in the target, secondary hadrons and muons that do 
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not decay are absorbed by a 400 m thick shielding made of iron and earth. 
The NOMAD detector is located at 835 m from the neutrino target. 

The detector is described in Ref. [9]. It consists of a number of sub-detectors 
most of which are located inside a 0.4 T dipole magnet with a volume of 
7.5x3.5x3.5 m 3 : an active target of drift chambers (DC) [10] with a mass of 
2.7 tons (mainly carbon), an average density of 0.1 g/cm 3 and a total thickness 
of about one radiation length (~ I.OXq) followed by a transition radiation 
detector (TRD) [11], a preshower detector (PRS), and an electromagnetic 
calorimeter (ECAL). The PRS is composed of a plane of horizontal and a 
plane of vertical proportional tubes preceded by a 9 mm thick lead plate 
(1.6 Xq). The ECAL consists of 875 lead-glass counters, each about 19 Xo 
deep, arranged in a matrix of 35 rows by 25 columns [12]. 

A hadron calorimeter (HCAL) and two muon stations are located just after 
the magnet coils. A plane of scintillation counters, V, in front of the magnet 
was used to veto upstream neutrino interactions and muons incident on the 
detector. Two planes of scintillation counters Ti and T 2 located before and 
after the TRD were used for triggering purposes. The trigger for neutrino 
interactions or decays in the DC target was then VT{r 2 . 

The electron identification efficiency in NOMAD is provided mainly by the 
TRD which has an efficiency of more than 90% for isolated electrons of mo- 
mentum 1 — 50 GeV/c for a charged pion rejection factor greater than 10 3 
[11]. 



3 Production and decay 

As follows from Eq. (1), any source of v T will produce all kinematically possible 
massive eigenstates according to the appropriate mixings. In this search the 
source of z/ T (z7 r )'s that can potentially generate z/ 4 's is D S (D S ) mesons produced 
in the reaction p + Be — > D s + X at the proton target and subsequently 
decaying leptonically: D s — > v T + r, r — > v T + X [14]. Up to a z/ 4 mass of 
190 MeV, the mass difference between the D s and the r, iVs can originate 
both from the v T produced directly in the D s decay and from the v T produced 
indirectly in the subsequent r decay. For a z/4 mass larger than 190 MeV only 
z/ r 's produced indirectly in r decay can contribute. However these indirect z/ T 's 
have a lower acceptance at NOMAD and a harder energy spectrum (Figure 
3) resulting in a smaller probability to observe the decay z/4 — > u T e + e~ in the 
NOMAD detector. Therefore this search is limited to z/4 masses smaller than 
190 MeV. If z/ 4 is a long-lived particle, the flux of z/4's would penetrate the 
downstream shielding without significant attenuation and would be observed 
in NOMAD through their z/ 4 — > v T e + e~ decays as illustrated in Figure 1. 
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For neutrino masses below the 7r°-meson mass, m„ 4 < m n , the dominant heavy 
neutrino visible decay is ve + e~ with a rate which, for small mixing, is given 
by [6,15] 

r 4 =T(v 4 ^is T e + e ) = K[ — * j (2) 

where ql = — 1/2 + sin 2 9w, 9r = sin 2 9w, K = 1(2) for Dirac(Majorana) 
particles. The corresponding diagram illustrating the dominant contribution 
from neutral weak currents to this decay mode is shown in Figure 2b. The 
branching ratio of the visible decay is given by 



B R(u 4 - u T e + e~) = T ^^ e+e } „ .14 (3) 

Ltot 

where the total rate T tot is dominated by the v 4 — > 3u decay channel. 

For m U4 > the two-body decay channel v 4 — > z/ r 7r° opens up. This mode is 
phase space favoured and becomes dominant for m VA > 140 MeV [16]. 

In this paper we have studied the decay v 4 — > v T e + e~ as a possible man- 
ifestation of the presence of U4S in the neutrino beam. The occurrence of 
v 4 — * u T e + e~ decays would appear as an excess of isolated e + e~ pairs in NO- 
MAD above those expected from standard neutrino interactions. The decay 
v 4 — > u T e + e~ cannot be distinguished from the anti- neutrino decay v± —> 
V T e + e~ and the result of this search therefore referes to the sum of these two 
decays. 

The spectra of z/ T 's produced in the Be target by primary protons were calcu- 
lated using the approach reported in ref. [17] (see also [18]). The contribution 
of protons not interacting in the Be target and interacting in the SPS beam 
dump at the end of the decay tunnel was also taken into account. The simu- 
lated energy spectra of i/ T 's pointing to the NOMAD fiducial area are shown in 
Figure 3. The flux of heavy neutrinos, $(^4), can then be expressed as follows: 

$(z/ 4 ) oc j da(p + D S (D S ) + X)/dE Vr ■ Br(D s (D s ) - r + v T ) ■ (4) 

■A 1/2 • h 1/2 ■ |C/ r4 | 2 • dE Vr 

where a(p + iV — > D S (D S ) + X) is the D s meson production cross-section 
[17,18], Br{D s — > r + v r ) is the r-decay mode branching ratio of the D s [14], 
and A 1 / 2 , h 1 ! 2 are the decay phase space and helicity factors, respectively [15]. 
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Once the z/4 flux was known, the next step was to calculate the e + e" spec- 
trum based on the differential z/ 4 — > v T e + e~ decay rate including polarization 
effects (see Figure 4) [16]. The decay electrons and positrons were tracked 
through the DC target including bremsstrahlung photons, their conversion 
and multiple scattering in the target. The details of the NOMAD simulation 
and reconstruction are described elsewhere [19]. 



4 Data analysis and selection criteria 

The search for z/ 4 — > u T e + e~ described in this paper uses the full data sam- 
ple collected with the VTiT 2 trigger [9] during the years 1996-1998. The data 
correspond to a total number of protons on target (pots) of 4.1 x 10 19 . The 
strategy of the analysis was to identify z/ 4 — > v T e + e~ candidates by reconstruct- 
ing in the DC isolated low invariant mass e + e~ pairs that are accompanied by 
no other activity in the detector. The measured rate of e + e~ pairs was then 
compared to that expected from known sources. 

The following selection criteria were applied: 

• two and only two tracks forming a vertex within the DC fiducial volume of 
2.4 x 2.4 x 3.5 m 3 equivalent to a mass of 1.97 tons; 

• at least one of the two tracks identified as an electron by the TRD (pion 
contamination probability < 1CT 3 [11]); 

• any additional track or converted photon [20] in the event were allowed only 
if their energies were less than 0.4 GeV or if they could be identified as due 
to bremsstrahlung photons from one of the two electron candidates; 

• no 7's in the ECAL with energy E 1 > 0.4 GeV (or E 1 > 0.3 GeV for 
7's converted in the PRS), which are incompatible with bremsstrahlung 
photons from the initial tracks; 

• total HCAL energy < 0.4 GeV. This cut serves as an HCAL veto and is 
confirmed by random trigger events and Monte Carlo (MC) studies [13]; 

• the total energy of the pair must be greater than 4 GeV and its invariant 
mass m e + e - < 95 MeV to remove background from pairs of particles other 
than e + e~. 

Only 207 events passed these criteria. At the next step we used a collinearity 
variable C = 1 — cosQ ue + e -, where Q ue + e - is the angle between the average 
neutrino beam direction and the total momentum of the reconstructed e + e~ 
pair. A cut on this variable allowed a more effective background suppression. 
A MC simulation of heavy neutrino decays shows (see Figure 5) that the 
z/ 4 — > u T e + e~ events have C < 2 x 10~ 5 . This was true for a z/ 4 mass up to 
~ 190 MeV. 
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In order to avoid biases in the determination of selection criteria, a blind 
analysis was performed. Events in a signal box defined by C < 2 x 10~ 5 were 
excluded from the analysis of the data until the validity of the background 
estimate in this region was established. This was done by verifying that the 
MC simulation of standard processes reproduced the data outside the box. 

The accuracy of the collinearity determination obtained with M C simulations 
was checked using a u^CC data sample with an e + e~ pair from a photon con- 
verted in the DC target at a large ( > 100 cm) distance from the primary 
vertex. Figure 6 shows the (1 — cosQ e + e -) distribution of such events in the 
data and simulation, where e + e - is the angle between the e + e~ pair momen- 
tum and the line joining the primary vertex to the conversion point. The small 
difference between the MC and data distributions in Figure 6 would result in 
an overall efficiency correction of less than 6%. However, in order to conserva- 
tively account for possible instrumental effects not present in the MC, the MC 
efficiency was multiplied by the efficiency of reconstructing e + e~ pairs with a 
collinearity variable C < 2 x 10~ 5 in the data sample of Figure 6 (~ 75%). 
Nonetheless, the two distributions are in reasonable agreement at all energies 
studied. This validates the resolution in the variable C (a few mrad in 0„ e + e -) 
predicted by the MC program. 

The reconstruction efficiency for the — > v T e + e~ decay in the NOMAD fidu- 
cial volume was calculated from the MC simulation as a function of e + e~ 
energy in the range 4 GeV to 50 GeV. The MC simulation was used to correct 
the data for acceptance losses, experimental resolution and reconstruction ef- 
ficiencies. Two checks using both experimental data and the MC simulation 
have been performed in order to verify the reliability of the simulation and to 
estimate the systematic uncertainties in the e + e~ pair efficiency reconstruc- 
tion in the energy range predicted by the simulation. 

The first method is to select two samples of reconstructed 7r°'s, one in which 
the two decay photons reach the ECAL, N% , and another in which one of the 
photons converts in the drift chambers, N*° +e -. For data and MC events the 



was then formed. The value of the double ratio RR = Rnatai 1 Rmc is then a 
measure of any differences in e + e~ reconstruction efficiency between the data 
and MC. The use of e + e~ pairs from n° decay enhances the purity of the e + e~ 
sample. 



ratio 




n:1 
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The method works well mostly for the low energy region, E e + e - < 10 GeV, 
when the 27 opening angle is relatively large and the distance between the 
photons in the ECAL is larger than the ECAL cell size. At higher energies 
the precision of this method is affected by the statistical uncertainties in the 
number of 7r°'s reconstructed in the 27 mode, because the resolution on the 27 
opening angle becomes worse and the n° peak is not well identified anymore. 

A similar method allowing a more accurate evaluation of the e + e~ efficiency 
correction factor at higher energies is based on the inclusive e + e~/7 double 
ratio RR defined again as RR = Roatai 1 Rmc with 



where Nj, Nj +e _ are the numbers of single isolated photons and e + e pairs 
in the same data sample of u^CC events used for the collinearity check. 

It was found that the two methods agree quite well in the low energy region 
and yield a correction factor close to 1. However, in the high energy region the 
e + e _ efficiency correction factor varied from 0.7±0.04 to 0.4±0.03 depending 
on the e + e~ energy. 



5 Background 

The largest contribution to the background is expected from neutrino inter- 
actions yielding a single n° with little hadronic activity in the final state. 
Neutrino interactions occuring in the coil and iron upstream of the DC fidu- 
cial volume may yield an isolated e + e~ pair if a photon from a 7r° produced 
in such an interaction converts in the DC and the accompanying particles are 
not detected. 

Because of the large mass of this upstream material the study of this back- 
ground would require the simulation of a very large number of events re- 
sulting in a prohibitively large amount of computer time. Consequently, only 
about 10% of the required statistics for u fl CC(NC) inelastic reactions were 
simulated, while other background components, such as u e CC, coherent n° 
production, quasi-elastic reactions and v^e scattering were simulated with a 
statistics comparable to the number of events expected from these reactions 
in the data. 

The distribution of the variable C for the sum of all the MC samples is shown 
in Figure 5. The plot covers the region C < 5 x 10~ 4 , which is 25 times larger 
than the size of the signal box. No v^CC{NC) event is found in this region. 
The data outside the box, also shown in Figure 5, are consistent with the MC 
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prediction (19 events observed and 20 ± 4 events predicted). The estimate of 
background from u^CC(NC) in the signal box is based on the observation that 
there are no physical reasons for this background to be other than flat in the 
region C < 5 x 10~ 4 . Two independent methods were used for the background 
estimation in the signal region. 

The first method is based on the MC. The MC background from the fully 
simulated reactions was found to be 2.5 ± 0.8 events inside the signal region. 
For the u^CC and u^NC events for which only 10 % of the data statistics 
was generated, no event was found in the full enlarged region C < 5 x 10~ 4 . 
Assuming that this background is distributed randomly in this interval and 
taking into account that the simulated sample corresponds to only 10% of 
data, we estimate the u^CC and v^NC background contribution to be O^; 4 
events inside the signal region. 

The second method relies on the data themselves. The agreement between 
the observed and predicted numbers of events outside the signal box allows 
to conclude that the number of background events from u^CC and u^NC 
processes is negligible. Thus, by extrapolating the 19 observed events to the 
signal region with the shape of the fully simulated MC events we obtain a 
second background estimate of 2.4 ± 0.9. 

The final background estimates with the two methods are = 2.5+o|(stot) 
±0.6(syst) events from the MC and A^ ta = 2A±° %(stat) ± 0.7(syst) events 
from the data, thus providing consistent results. The systematic error includes 
the uncertainties in the number of pot (5%) and in the coherent 7r° production 
cross section (25%). In addition, in the second method we also take into ac- 
count the systematic errors related to the extrapolation procedure. The total 
systematic uncertainty was calculated by adding all errors in quadrature. In 
the following we use the background estimate extracted from the data them- 
selves. 



6 Results and calculation of limits 



Upon opening the signal box we have found one event that passes our selec- 
tion criteria. This is consistent with the expected background and hence no 
evidence for isosinglet neutrino decays has been found. We can then determine 
the 90% CL upper limit for the corresponding mixing amplitude \U rli \ 2 from 
the 90% CL upper limit for the expected number of signal events, A"" 4 P _^ e+e _. 
Using the frequentist approach of ref. [21] and taking into account the uncer- 
tainties in the background estimate [221 we obtain N np + _ =2.1 events. 
Since the number of observed events is less than the predicted background, 
this limit is lower than the corresponding sensitivity, +er . = 4.0. The 
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sensitivity is denned as the average upper limit obtained in the absence of sig- 
nal events by an ensemble of experiments with the same expected background 
[21]. The probability to obtain an upper limit of 2.1 or lower is 29%. 

For a given flux $(^4), the expected number of z/ 4 — > u T e + e~ decays occuring 
within the fiducial length L of the NOMAD detector located at a distance V 
from the neutrino target is given by 



N VA ^ UT e+e- = I $(^4) " exp{-L'm u Jp Ui T A ) ■ [1 - exp(-Lm u Jp Ui T A )} (7) 

•(r e+e -/r tot ) ■ e ■ A - dE Ui oc |£7 t4 | 4 



where p U4 is the 1S4 momentum and r 4 is its lifetime at rest, T e + e -, F tot are the 
partial and total mass dependent z/ 4 -decay widths, respectively, and e is the 
e + e~ pair reconstruction efficiency The acceptance A of the NOMAD detector 
was calculated tracing z/4's produced in the Be-target or beam dump to the 
detector taking all relevant momentum and angular distributions into account 
[17]. As an example for a mass m VA = 33.9 MeV, A = 1.4% and e = 26%. The 
flux $(z/ 4 ) is given by Eq. (4). 

The final 90% CL upper limit curve in the (m U4 ; |f/ r4 | 2 ) plane is shown in 
Figure 7 together with the Big Bang Nucleosynthesis (BBN) and Supernova 
SN1987a lower limits obtained in ref. [6]. For the mass range m V4 > the 
shape of the NOMAD limit curve is explained by the contribution from the 
z/ 4 — > u t tt° decay to the z/ 4 decay rate: as the v± — + z/ r 7r° decay channel opens 
up, the branching ratio BR(z/ 4 — > u T e + e~) drops rapidly as m VA increases. 



7 The KARMEN time anomaly 

Our data can also be used to restrict one of the interpretations of the time 
anomaly observed by the KARMEN experiment [23] . The anomaly is a bump 
in the time distribution of v e and induced events which was expected to 
be well described by the single exponential from muon decays.Q The KAR- 
MEN Collaboration interpreted the anomaly as being due to an exotic decay 
of 7r + -mesons into a muon and a 33.9 MeV new fermion X and reported a 
signal curve for pion branching ratio BR(tt + — > fi + + X) x T(X — > e + e~v) as 
a function of X-lifetime with a branching ratio BR(ir + /i + + X) as small as 
10~ 16 [23]. This and other hypotheses explaining the anomaly have been re- 
cently extensively investigated both theoretically [5,25,26] and experimentally 

1 This anomaly, seen in the KARMEN1 data, was not confirmed with the KAR- 
MEN2 data [24]. A possible explanation of this effect may be found in ref. [28]. 
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[27,29]. 



Barger et al. [5] associated the new particle with a 33.9 MeV isosinglet neutrino 
dominantly mixing with u T . From our limit curve in Figure 7, we have found 
using Eqs. (2,3) that for m VA = 33.9 MeV the lifetime of such a neutrino has 
to be greater than ~ 10~ 2 sec while the BBN lower limit of ref. [25] constrain 
the z/4 lifetime to be less than 0.1 secQ Using the KARMEN signal curve 
[23] results in a small window around BR(-k + — > fi + + X) ~ 10 -12 between 
our result [16] and BBN one left untested. Note that the recent PSI result 
on a search for the 33.9 MeV particle in ir + — > fi + + X decay corresponds to 
BR(n + ^/j + + X)< 6.0 ■ 10^ 10 at 95% CL [27]. 



8 Conclusion 

We found no evidence for the existence of a heavy neutrino, z/4, with mass 
in the range 10 - 190 MeV which mixes dominantly with the v r and decays 
into v T e + e~. For the first time an upper limit on the square of the mixing 
amplitude, |t/ T 4| 2 , is obtained. Windows between our result and the BBN and 
SN1987a limits are still of interest for further searches. 
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Proton beam, 450 GeV/c 




Steel, earth NOMAD detector 

shielding 



Fig. 1. Schematic illustration of the production of 1/4 and its detection via the 
1/4 — > z/j-e+e - decay. Because of its short lifetime the D s decays immediately at 
the production point. 




e 



Fig. 2. Feynman diagrams illustrating a) production from D S (D S ) decay and b) 
the decay of an isosinglet neutrino v^. 
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Fig. 3. Combined energy spectra of tau neutrinos pointing towards the NOMAD fidu- 
cial area from the proton target and from the beam dump a) originating directly from 
D S (D S ) decays; b) originating from the decays of produced in D S (D S ) decays; c) 
the sum of the two. The spectra are calculated for 10 11 protons on target (pot). 



18 



> 

0) 

(5 



E 



450 
400 
350 
300 
250 
200 
150 
100 
50 




- helicity +1 
— helicity -1 




10 



20 



30 



40 



50 60 
E(GeV) 



Fig. 4. Energy distribution of e + e~ pairs from decays of a v± with 33.9 MeV mass 
for different v± helicities. The average e + e~ pair energies are < E >+i= 16.4 GeV 
and < E >_i= 14.1 GeV for helicities +1 and -1, respectively. 
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Fig. 5. The final (1 - cosQ ve + e -^ distribution for the data and MC. The dashed 
histogram represents the distribution expected from signal events. 
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Fig. 7. The NOMAD 90% CL upper limit, and the SN1987a and Big Bang Nu- 
cleosynthesis lower limits for the mixing strength \U T 4\ 2 as a function of the heavy 
neutrino mass. The SN1987a and BBN limits are reproduced from ref. [6j. Note 
that upper limits of \U t4 \ 2 < 1(T 8 from SN1987a and \U r4 \ 2 < 1(T 10 + 10" 12 from 
BBN arguments have also been derived for the corresponding mass ranges shown, 
respectively. For more details see ref. [6]. 
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